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Abstract 

Subsampling and block-based bootstrap methods have been used in a wide range 
of inference problems for time series. To accommodate the dependence, these resam- 
pling methods involve a bandwidth parameter, such as subsampling window width 
and block size in the block-based bootstrap. In empirical work, using different band- 
width parameters could lead to different inference results, but the traditional first 
order asymptotic theory does not capture the choice of the bandwidth. In this arti- 
cle, we propose to adopt the fixed-6 approach, as advocated by Kiefer and Vogelsang 
(2005) in the heteroscedasticity-autocorrelation robust testing context, to account 
for the influence of the bandwidth on the inference. Under the fixed-6 asymptotic 
framework, we derive the asymptotic null distribution of the p- values for subsampling 
and the moving block bootstrap, and further propose a calibration of the traditional 
small-6 based confidence intervals (regions, bands) and tests. Our treatment is fairly 
general as it includes both finite dimensional parameters and infinite dimensional 
parameters, such as marginal distribution function and normalized spectral distri- 
bution function. Simulation results show that the fixed-6 approach is more accurate 
than the traditional small-6 approach in terms of approximating the finite sample 
distribution, and that the calibrated confidence sets tend to have smaller coverage 
errors than the uncalibrated counterparts. 
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pling. 
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1 Introduction 



Subsampling and block-based bootstrap methods have been widely used in inference prob- 
lems for time series; see Politis et al. (1999a) and Lahiri (2003) for book-length treatments 
of these important resampling methods. To accommodate the unknown time series de- 
pendence nonparametrically, these methods introduce a bandwidth parameter /„, such as 
the block size in the block-based bootstrap and the subsampling window width in sub- 
sampling. The bandwidth plays an important role in the finite sample performance of 
subsampling or block bootstrap based inference. Intuitively, if the bandwidth (or block 
size) is too small, it may not capture the dependence in a time series sufficiently, whereas 
if it is too large, the number of blocks for subsampling/resampling is too small to lead to a 
good approximation of finite sample distribution. Statistically speaking, the bandwidth /,„ 
is a smoothing parameter as it usually leads to a bias- variance tradeoff in variance estima- 
tion or size-power tradeoff in testing on the basis of subsampling and block bootstrap. In 
the traditional asymptotic theory, /„ goes to infinity as sample size n goes to infinity and 
the fraction h = In/n goes to zero, which is a necessary condition for the general consis- 
tency of subsampling and block-based bootstrap methods without additional assumptions. 
Therefore, the role of (or h) does not show up in the conventional first order asymp- 
totics, although in practice the choice of /„ does affect the subsampling/block bootstrap 
distribution estimator and related operating characteristics. 

In this paper, we aim to offer a new perspective on the use of these smoothing parameter 
dependent resampling methods based on the so-called fixed-6 approach, which was first pro- 
posed by Kiefer and Vogelsang (2005) in the context of heteroscedasticity-autocorrelation 
robust (HAR) testing. It was found that the asymptotic distribution obtained under the 
fixed-6 framework (i.e. h G (0, 1] is held fixed in the asymptotics) provides a better approx- 
imation to the sampling distribution of the studentized test statistic than its counterpart 
obtained under the small-6 framework (i.e., 6 — as ra -> oo). See Jansson (2004) and 
Sun et al. (2008) for rigorous theoretical justifications. The fixed-6 approach has the ad- 
vantage of accounting for the effect of the bandwidth, as different bandwidth parameters 
correspond to different limiting (null) distributions. The literature on inference using the 
fixed-6 approach and its variants has been growing steadily; see Hashimzade and Vogelsang 
(2008), Sun et al. (2008), Shao (2010a), Goncalves and Vogelsang (2011), and Sayginsoy 
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and Vogelsang (2011) among others for recent contributions. 

In this paper, we adopt Kiefer and Vogelsang's fixed-6 approach and investigate its pos- 
sible gain in the context of subsampling [Politis and Romano (1994)] and the moving block 
bootstrap [Kiinsch (1989) and Liu and Singh (1992)]. The extension to other bandwidth- 
dependent bootstrap methods, such as the tapered block bootstrap [Paparoditis and Politis 
(2001, 2002), Shao (2010b)] and the dependent wild bootstrap [Shao (2010c)] are possible 
but are not pursued here. Under the fixed-6 asymptotics, Lahiri (2001) showed that the 
subsampling and the moving block bootstrap approximations are no longer consistent in 
the case of sample mean, which seems to suggest that a direct application of the fixed-6 
approach is fruitless. A novel feature of our extension is that we study the limiting null 
distribution of the p-value, which is f/(0, 1) (i.e., uniform distribution on [0, 1]) under the 
small-6 asymptotics, but is dependent upon b and differs from f/(0,l) under the fixed-6 
asymptotics. For a scalar parameter, we calibrate the nominal coverage level on the basis 
of the pivotal limiting null distribution of the p-value under the fixed-fe framework, and 
modify the small-6 based confidence interval by inverting the corresponding test. Thus the 
impact of the bandwidth parameter on the subsampling/block bootstrap distribution 
approximation is captured to the first order using a p-value based adjustment. Simulation 
studies are conducted to demonstrate that the fixed-fe approach delivers confidence inter- 
vals of better coverage in most situations and that the fixed-6 based intervals are slightly 
wider than the small-6 counterparts, consistent with early findings associated with the 
fixed-b approach; see e.g. Kiefer and Vogelsang (2005). 

So far the use of the fixed-6 approach has been restricted to the inference of a finite 
dimensional parameter. Since the subsampling and moving block bootstrap have also been 
used in the inference of infinite dimensional parameters, such as marginal distribution 
function and (normalized) spectral distribution function of a stationary time series, we 
explore an extension of the fixed-fe idea to construct confidence bands for these infinite 
dimensional parameters. Unlike the case of a scalar parameter, the limiting null distribu- 
tion of the subsampling-based p-value is not pivotal under the fixed-6 asymptotics and it 
depends on the unknown dependence structure of the underlying process. To alleviate the 
problem, we apply the subsampling method to approximate the sampling distribution of 
the p-value so inference becomes feasible. This double subsampling approach is also used 
in constructing the confidence region for a vector parameter. 
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The remainder of the article is organized as follows. Section [2] introduces an extension 
of the fixed-6 approach to subsampling and the moving block bootstrap in the mean case. 
Section [3] lays out a general framework and describes the fixed-6 based confidence interval 
(region) for a finite dimensional parameter and some implementational issues. Section H] 
presents an extension of the fixed-6 approach to confidence band construction for the 
marginal distribution function and normalized spectral distribution function. Simulation 
results are reported in Section [51 Section [6] concludes and Section [7] contains some technical 
details. 

2 Inference for the mean 

To help the reader understand the essence of the fixed-6 approach, we shall focus on the 
simple problem: inference for the mean of a stationary time series. Suppose we want to 
test Hq : fi = fiQ versus Hi : fi ^ fiQ based on the observations {Xt}^^i from a univariate 
stationary time series with E(Xt) = fi. Under suitable moment and weak dependence 
conditions, we have ^Jn{Xn — yu) — t-/) A^(0, ct^) where = ^fcez7(^) ^'^^ ^^^S 
variance with 7(/c) = cov(Xo,Xyfc) and "— j-d" denotes convergence in distribution. The 
scale parameter cx^ can be consistently estimated by the so-called lag window estimator 
a\ = X]j=i-n /^)ln{j), where / = /„ is a bandwidth parameter, K{-) is a kernel function 
and 7n(j) = J22=\j\+ii-^k — ^n){Xk-\j\ — ^n) is the sample autocovariance at lag j. 

A natural test statistic is G„ = n{Xn — fio)'^/^^- To ensure the consistency of as 
an estimator of a^, the bandwidth parameter / = bn, where b G (0, 1], typically satisfies 
1/l+l/n = o(l) (i.e., b+n~^/b = o(l)) as — )■ oo. This is the so-called small-6 asymptotics, 
under which the limiting null distribution of G„ is the distribution of Xi- Under the fixed- 
b asymptotics, the ratio of bandwidth to sample size b is held fixed and G.„ converges 
in distribution (under the null) to U{b), whose detailed form can be found in Kiefer and 
Vogelsang (2005). The distribution of U{b) depends on the kernel K and b, so different 
choices of the kernel and bandwidth lead to different limiting null distributions. From both 
empirical and theoretical perspectives, the fixed-6 approach has been shown to provide a 
more accurate approximation to the finite sample distribution of G„ than the small-6 
counterpart under the null, so it corresponds to better size in hypothesis testing. Owing to 
the duality between confidence interval construction and hypothesis testing, the interval 
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delivered by the fixed-6 approach tends to have an empirical coverage closer to the nominal 
one. 

In the next two subsections, we describe an extension of the fixed-6 approach to subsam- 
pling and the moving block bootstrap for the mean inference problem. A further extension 
to the inference of a finite dimensional parameter is made in Section |31 Throughout, we 
use [aj to denote the integer part of a G M and \a\ to denote the smallest integer larger 
than or equal to a. The symbol N{fi, S) denotes the normal distribution with mean fi and 
covariance matrix S. 

2.1 Subsampling 

For the inference of the mean, the subsampling method approximates the sampling distri- 
bution of ^/n{Xn — f^) with the empirical distribution generated by its subsample coun- 
terpart Vl{Xjj+i_i - Xn), where Xjj+i_i = /"^ Y.i=j~^ Xi, j = 1, ■ ■ ■ , N = n - I + 1. Let 
Ln,i{x) = N~'^ Xl^i llv^l^jj+'-i ^ -^n) < x} be the subsampling approximation, where 
1(A) denotes the indicator function of the set A. For a given a G (0, 1) (say, a = 0.05 or 
0.1), we define the subsampling-based critical values as c„,/(l— a) = inf{a; : Ln,i{x) > 1— a}. 
Then a 100(1 — a)% (one-sided) confidence interval is [Xn — n^^^'^Cn,i{l — a), oo) and the 
100(1 — a)% (two-sided) equal-tailed confidence interval is [Xn — n~^^'^Cn,i{l — a/2),X„ — 
n~^^'^Cn,i{o!/2)]. In the testing context, if the alternative hypothesis is Hi : fi > /io, then 
we reject the null hypothesis at the significance level a if /iq ^ [Xn — n~^/'^Cn,i{l — a), oo); 
if the alternative hypothesis is Hi : fi < /ig, then the null is rejected provided that 

^ {—oo,Xn — n~^/^c„,^i(a)], which is also a one-sided confidence interval with nominal 
level (1 — a); If the alternative hypothesis is Hi : n ^ /iq, then the null hypothesis is rejected 
when /io ^ [Xn — n~^/^c„,,i(l — a/2),Xn — n~^^'^Cnj{a/2)\. The above inference is based on 
the traditional small-6 based asymptotic theory, under which sup^^gig \Ln,i{x) — $(x/cr)| = 
Op(l), where $ is the distribution function for the standard normal distribution, and 
sup^jgig |L„^;(x) — P{y/n{Xn — /i) < x}\ = Op(l), i.e., the subsampling method provides 
a consistent approximation to the sampling distribution of ^/n{Xn ~ f^) and its limiting 
distribution. Note that we are using the data-centered subsampling distribution for testing 
as recommended by Berg et al. (2010). 

Under the fixed-6 framework, Ln,i does not converge to A^(0, o"^) in distribution. Instead, 
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Lahiri (2001) showed that the hmit of Ln^i{x) is 

(1 - by^ / l[{W{b + t)- W{t) - bW{l)}a/Vb e (-00, x]]dt, 
Jo 

where W{t) is a standard Brownian motion. Since Ln,i converges to a random measure, 
the subsamphng-based inference is asymptotically invalid under the fixed-fe framework. 
To alleviate the problem, we shall modify the traditional subsampling-based inference 
procedure by considering the subsampling-based p-value and its limiting null distribution. 
For the one-sided alternative hypothesis Hi : fi > fiQ, we define the p-value as 

1 ^ 
i=i 

Under the small-6 asymptotics, it can be shown that pval^Y^ converges to [/[0, 1] in distri- 
bution under the null, whereas under the fixed-b asymptotics, its limiting null distribution 
is the distribution of G{b), where 

l>l-b 

G{b) = (1 - by^ / < {W{b + t) - W{t) - bW{l)}/y/b]dt. 

Jo 

Note that the nuisance parameter a is canceled out in G{b), which is pivotal for a given 
b. Let Ga{b) denote the 100a% quantile of the distribution G{b). Then at the significance 
level a, we reject the null and favor the alternative Hi : fi > fi^, if the (realized) p-value 
is smaller than Ga{b). Correspondingly, a one-sided confidence interval under the fixed-6 
asymptotics can be obtained by inverting the test, i.e., {/i : j^J2f=i'^{V^i-^n — /^) < 
- Xn)} > Ga{b)}, which is 

{/i : v^(X„ - /i) < Cn,i{l - Ga{b))} = [X„ - n-'/^Cn,i{l - Ga{b)), oo). 

Compared to the conventional subsampling-based confidence interval, the difference lies in 
the replacement of a by Ga{b) in Cn,i. Note that a is the 100a% quantile of f/(0, 1), which 
is the limiting null distribution of the p-value under the small-6 asymptotics. In a similar 
manner, we can obtain the 100(1 — a)% two sided equal-tailed confidence interval for /i 
as [Xn — n~^/^c„,i(l — Ga/2ib)), Xn — n~^^'^Cn,i{Ga/2ib))] and another one-sided confidence 
interval (— oo,X„ — n^^^'^Cn,i{Ga{b))] under the fixed-6 asymptotics. One can view the 



6 



fixed-6 based inference as a way of calibrating the small-6 counterpart with the level a 
adjusted by Ga{b), so the effect of b on the inference is taken into account. 

If one wants to construct a symmetric two sided confidence interval for /i, then one can 
approximate the sampling distribution of A/n|X„— /i| by Ln,i{x) = XljLi l(v^l^i,j+i-i~ 
Xn\ < x). Letting Cn,i{i — a) = mf{x : Ln,i{x) > 1 — a}, then the 100(1 — a)% symmetric 
confidence interval for /i is [Xn — n~^^'^'cn^i{^ — a), X„ + n~^^'^Cn,i{l — a)] under the small-& 
asymptotic theory. The p-value is defined as 

gJJQ 1 

Pvaln,i = J^Yl HVn\Xn - ^ol < Vl\Xjj+i^i - X„|}. 

^ SUB 

Under the fixed-6 asymptotics, the limiting null distribution of pval^ i is the distribution 
of G{h), where 

G{h) = (1 - hy^ / 1{|IV(1)| < \W{h + t) - W{t) - hW{l)\/Vh}dt. 
Jo 

Let Ga{b) denote the 100a% quantile of the distribution G{b). Then the fixed-fe based 
100(1 — a)% symmetric confidence interval is {fi : ^j^i l(v^l^n — A^l < 
Xn\) > G^{b)}, i.e., 

[X„ - _ G,(6)), X„ + _ G,(6))]. (1) 



2.2 Moving block bootstrap 

In this subsection, we shall consider the approximation of the sampling distribution of 
y/n{Xn-fi) by the moving block bootstrap (MBB). Denote the MBB sample by {X*(/), ■ ■ ■ , X*{1)} 
with the dependence on the block size / being explicit. Then we approximate the sam- 
pling distribution of ^/n{Xn — f^) by the conditional distribution of \/n{X*{l) — Xn} or 
y/n[X*{l) - E*{X*{1)}] given the data, where X*{1) = n"^ Ylt=i ^^(0 is the sample mean 
for the bootstrap sample, E* and var* are used to denote the conditional expectation and 
variance, respectively. To avoid the issue of centering, we could use the circular bootstrap 
[Politis and Romano (1992)], which is asymptotically equivalent to the moving block boot- 
strap [Lahiri (2003)]. For simplicity, we shall focus on the bootstrap approximation based 
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on y/n{X*{l) —Xn}- The same idea can be applied to the other bootstrap approximation. 
We define the MBB-based p-value as 



which corresponds to the alternative Hi : fi > fi^. Under the small-6 asymptotics, the 
p-value pval^^^ is expected to converge to U{0,1) in distribution under the null, al- 
though we are unaware of a formal proof. Under the fixed-6 asymptotics, we assume 
Rb = 1^/^ = 1/b (i.e. reciprocal of b) to be an integer for the ease of our discussion. 
Then X*{1) = n~^Y.f=iX*il) = n~^J2fliVj, where, conditional on the data, {v*}f^i 
are iid (independent and identically distributed) with a discrete uniform distribution, 
= J2t=i~^ -^t) ~ 1/^5 J = I5 ■ ■ ■ , N. Hence the above p-value is equal to 



N 



Under the fixed-6 asymptotics and the null, it converges in distribution to 



b) 











Jo 





J^{W{tf, + b)-W{t,)}>2W{l) 



h=l 



dti ■ ■ ■ dti 



Let Ha{b) denote the 100a% quantile of H{b). In practice, we usually further approximate 
the distribution of ^/n{X*{l) — X„} by taking a finite number of bootstrap samples, say, 
{Xj*'"'(/)}"^]^, j = I,-- - ,B. We approximate the sampling distribution of y/n{Xn — /w) 



by m: 



LB 



c: 



n,LB\ 



■a) 



- iEf=il[y^W^(0 -X} < x], where X^'^il) = n'^ ELi ^^"(O- Let 
inf{x : M* i^^{x) > 1 — a}. The corresponding fixed-6 based two sided equal 
tailed confidence interval for /i is then 

[Xn - n-^/^c;,,^(l - H^/^m Xn - n~'/Xi^^iH^/2ib))] 

and the one-sided confidence intervals can be formed analogous to those developed for 
the subsampling method. The details are omitted. The above discussion is based on the 
assumption that i?;, = 1/6 is an integer. When Rh is not an integer, we use a fraction of 
the last resampled block to make the bootstrap sample size equal to original sample size. 
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Then the p-value is 



N 



l[Rb\+l 



JLflbJ+i+^-'L-RfcJ"! \ 1 

*=JL«6J+i / J 

and its hmiting null distribution can be derived similarly. Below we shall focus our discus- 
sion on the case 1/6 is an integer for simplicity. 

In a similar fashion, if we want to construct an MBB-based symmetric confidence 
interval for /i, we consider the approximation of the sampling distribution of ^/n\Xn — fJ'\ 
by the conditional distribution of ^/n\X*{l) — X„| given the data. The corresponding 
p-value is 

— MBB ^ - ^ - 

Vval^^, := E*{l(v^|X„ - ^ol < MKX^) - M)} 

Rb jh+l-^ 



NRb 



N 

E 



n 



jl,j2,— JiJi, = l 

and it converges in distribution to 



> Vn\Xn - Hq\ 



H{b) = 



1-b 



1-6 



J2{W{tk + b)~W{tj,)}-W{l) 



h=l 



under the null. Define M*ij^{x) = ^ Y.j=i l{v^l^n^(0 - < x} and ^^^(1 
inf{x : M*iq{x) > 1 — a}. Then the fixed-fe based 100(1 — a)% symmetric confidence 
interval for ^ is [X, - n^^/^-* ^ _ Ha{b)),Xn + n-'/^cl , ^(1 - H^{h))]. 



> \W{1)\ \dh---dtR^ 



a) 



3 Finite dimensional parameter 

We first introduce some notation. Let D[0, 1] be the space of functions on [0, 1] which are 
right continuous and have left limits, endowed with the Skorokhod topology (Billingsley 
1968). Denote by weak convergence in D[0, 1] or more generally in the R'"'- valued 
function space D''[0, 1], where k E N. Later in Section HJ we also use to denote the 
weak convergence in D[0, n], D{[0, 1] x [0, tt]) and D{[—oo, oo] x [0, 1]). 
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3.1 Subsampling 

Following Politis et al. (1999a), we assume that the parameter of interest is 6{P) G M'^, 
where P is the joint probability law that governs the p-dimensional stationary sequence 
{Xt}t&- Let On = 6n{Xi,--- ,Xn) be an estimator of 6* = d{P) based on the observa- 
tions (Xi, ■ ■ ■ ,X„). Further we define the subsampling estimator of 6{P) by Oj j^i^i = 
9i{Xj, ■ ■ ■ , Xj^i-i) on the basis of the subsample {Xj, ■ ■ ■ , Xj+i^i), j = 1, ■ ■ ■ ,N. Let || ■ || 
be a norm in W^. The subsampling-based distribution estimator of ||-\/ri{^n — is 
denoted as Ln^i{x) = — < x). In the testing context (say 

Hq : 9 = 9o versus Hi : 9 ^ 9q) , we define the subsampling based p- value as 

N 

p^lZ'' = N-'Y.^{\\^{9n-9)\\ < \\Vli9,,^i^i-9n)\\), (2) 
i=i 

where we do not distinguish 9 and for notational convenience because they are the same 
under the null. 

To obtain the limiting null distribution of the p-value under the fixed-6 framework, we 
further assume 9{P) = T{F), where F is the marginal distribution of Xi G MP, and T is a 
functional that takes value in M.''. Then a natural estimator of T{F) is 9n = T(pi^„), where 
Pi,n = X]"=i ^Xt is the empirical distribution. Here 6^ stands for the point mass at x. 
Similarly, 9jj+i_i = T{pj j+i_i), where pjj+i^i = JZht^j'^ ^Xh- Assume that there is an 
expansion of T(pi „) in the neighborhood of F, i.e., 

n 

t=i 

where IF{Xt] F) is the influence function of T (Hampel, Ronchetti, Rousseeuw and Sta- 
hel, 1986) defined by IF{x; F) = lim^^o and Ri^n is the remainder term. 

Similarly, T{pjj+i_i) = T{F) + /"^ Eltj"^ IF{Xh; F) + Rjj+i-v Below are the two key 
assumptions we need. 

(A.l) Assume that E{IF{Xf,F)} = and n-^/^ ^j^i JF(Xj; F) S(P)i/Wfc(r), 
where S(P) is a positive definite matrix and Wk{-) denotes the k-th dimensional vector of 
independent Brownian motions. 

(A. 2) Assume that v^||-Ri^„|| = Op(l) and a// sup^^^ ...^^ = Op(l). 
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Note that (A.l) is Assumption 1 in Shao (2010a) and its verification has been discussed 
in Remark 1 therein. The assumption (A. 2) is to ensure the neghgibihty of remainder 
terms. In the sample mean case, IF{Xt; F) = {Xt — fi) and the remainder terms vanish, 
so (A. 2) is automatically satisfied and (A.l) reduces to a functional central limit theorem 
for the partial sum process of Xf. 

Theorem 1. Suppose the assumptions (A.l) and (A. 2) hold and b G (0, 1] is held fixed as 

SUB ~ 

n — )■ oo. The limiting null distribution of pval^^ is the distribution of G{b; k), where 



G{b-k) = (i-b)-' / impy/'Wk{i)\\ < \\j:{py/'{w,{b+t)-Wk{t)-bw,{i)}\\/Vb]dt. 



Jo 

In the special case k = 1, G{b] 1) = G{b). 

Thus for a scalar parameter, the limiting null distribution of the p-value is pivotal for 
a given b and the 100(1 — a)% symmetric confidence interval for 6 is 



which reduces to ([I]) in the mean case. To conduct the inference for the case k = 1, we need 
to know Ga{b), Ga{b), Haib) and Ha{b). Following the practice of Kiefer and Vogelsang 
(2005), we first generate the simulated values for a = 0.05, 0.1 and b = 0.01, 0.02, ■ ■ ■ , 0.2, 
then fit the quadratic equation cv{b) = ao + aib + a2b^ to the simulated values by ordinary 
least squares. The intercept ao was set to be equal to a, so that cv{0) = a. Table [H 
reports the estimated coefficients and from the regressions (ranging from 0.9584 to 
0.9997), which suggests quite satisfactory fits. For Haip) and Ha{b), fitting higher order 
polynomials does not lead to substantial higher R^. To simulate Ga{b) and Ga{b) for a given 
a and b G (0,0.2), we generate 5000 iid A^(0, 1) random variables, and use its normalized 
partial sum to approximate the standard Brownian motion. For Ha{b) and Ha{b), we 
approximate E* in the definition of p-value by performing bootstrap 50000 times. 50000 
monte carlo replications were used for all the cases. For small a (say a = 0.01) and 
relatively large b, say b = 0.15, ■ ■ ■ ,0.2, our simulated critical values are mostly zero, so 
we are unable to provide a fitted quadratic equation when a is very small. Nevertheless, if 
the goal is to construct a 90% or 95% symmetric confidence interval, or a 90% equal-tailed 
confidence interval, or a one-sided confidence interval of nominal coverage 90% or 95%, 
Table OD is useful when b G (0,0.2]. 




n 



Kl - G^{b)), On + _ G^{b))l 



11 



Please insert Table [T] about here! 
For a vector parameter (i.e. k > 2), the limiting null distribution of the p- value depends 
on the unknown long run variance matrix, so is not pivotal in general. One way out is to 
approximate the limiting null distribution by subsampling. Denote by n' the subsampling 
width at the second stage. Let /' = and A^' = n' — I' + 1. For each subsample 

SUB 

{Xt, ■ ■ ■ ,Xt^n'~~i}, we define the subsampling counterpart of pval^i as 

t+N'-l 

qn',t={NT' Yl 1{||V^(W-1- W-l)ll > l|v^(W-l-^"n)||} 

j=t 

for t = 1, ■ ■ ■ ,n — n' + 1. Denote the empirical distribution function of {qn\t}t=r~^^ by 
Qn,n'ix) = {n — n' + l)^"*^ Xlj=" — ^)) which can be used to approximate the 

^ SUB 

sampling distribution or the limiting null distribution of pval^i . Let Cny^i{l — a) = 
inf {x : Qn,n'ix) > 1 — a}. Then the calibrated 100(1 — a)% subsampling-based confidence 
region for 6 is 

{6 e : p^^SfJ'' in (ED > Cn,n',i{a)}^ (3) 

whereas the traditional subsampling-based confidence region is G M'^ : pva^i^ in (|2]) > 
a}. 

Theorem 2. Assume that 1/n' + n' /n = o(l) and b G (0, 1] is fixed. Suppose that the 
process Xt is a-mixing and G{b; k) is a continuous random variable. Then we have 

sup \Qn,n'{x) - P{G{b; k)<x)\= 0,(1). 

Consequently, the asymptotic coverage probability of confidence region in Ij^ is (1 — a). 

Remark 1. As we have done subsampling twice, this procedure is naturally called dou- 
ble subsampling in the spirit of double bootstrap. The use of subsampling at the second 
stage is mainly to approximate the sampling distribution or the limiting null distribution 
of the p- value, which is unknown under the fixed-6 asymptotic framework. Of course, the 
approximation error depends on the subsampling window size n' at the second stage. If 
we view n'/n as a fixed constant in the above asymptotics, then the asymptotic cover- 
age of the calibrated confidence region is still different from the nominal level. One can 
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perform further calibration by subsampling, which leads to iterative subsampling, similar 
to iterative bootstrap in Beran (1987, 1988). In practice, however, the selection of the 
subsampling window size at each stage usually involves quite expensive computation, and 
the (finite sample) improvement in coverage errors is not guaranteed by doing subsampling 
iteratively. 

As pointed out by a referee, a possible alternative approach is to simulate the asymp- 
totic null distribution of the p-value, i.e. the distribution of G{b] k) after plugging in a 
consistent estimator of long run variance matrix. Note that in general consistent estima- 
tion of long run variance matrix also involves the bandwidth selection; see e.g. Politis 
(2011). Since the above-mentioned double subsampling approach is also applicable to the 
infinitely dimensional case [see Section H], we shall not pursue this alternative approach. 



3.2 Moving block bootstrap 



For the moving block bootstrap, we approximate the sampling distribution of 

by the conditional distribution of A/n(^* - 9n), where ^* = 9n{X^{l), ■ ■ ■ ,X*(/)}. Define 

^ MBB - - 

the p-value as pval^i := E*{l(||y^(6'„ — 6'o)|| < ||a/^(6'* — 6'„)||)}. It can be expected 

MBB 

that under certain regularity conditions, the limiting null distribution of pval^ ^ is the 
distribution of 



H{h] k) 



;i - h)R^ 
> I 
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5^{Vrfc(U + b)- Wk{th)} - Wk{l) 



.h=l 



j:{pY^'w,ii)\\]dt,---dtj 



which coincides with H{b) when k = 1. When k > 2, the p-value is not asymptotically 
pivotal under the fixed-fe asymptotics, and its sampling distribution can be approximated 
by subsampling or the moving block bootstrap. Since the idea is similar to the double 
subsampling procedure described above, we omit the details. We mention in passing that 
Lee and Lai (2009) have recently studied the benefit of performing double block bootstrap 
for the smooth function model. 

The p-value based calibration is closely related to the prepivoting method proposed by 
Beran (1987, 1988). The p-value of a statistic is itself a statistic that has a pivotal limiting 
distribution or tends to be more pivotal than the original (unstudentized) statistic. In 
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Beran (1987), the limiting null distribution of the p- value was assumed to be U{0, 1), and 
he focused on the refinement of the approximation error of sampling distribution of the p- 
value to U{0, 1) by prepivoting and iterative bootstrap. His treatment is quite general but 
is mainly focused on the iid setting. By contrast, we deal with time series with independent 
data as a special case and the limiting null distribution of the p-value (under the fixed-6 
asymptotics) is not U{0, 1). In addition, our calibration can be applied to the inference 
of infinite dimensional parameters [see Section U], which is not covered by Beran (1987, 
1988). Another related calibration method in the bootstrap literature was proposed by Loh 
(1987, 1991), who calibrated confidence coefficients using a consistent estimate of actual 
coverage probability. For a given confidence interval, its estimated coverage probability 
is used to alter the nominal level of the interval, and it is shown that the calibrated 
interval is asymptotically robust under iid assumptions and some regularity conditions. 
Similar to Beran's work, Loh's discussion is limited to the iid setting and his calibration 
method seems only applicable to the inference of finite dimensional parameters. For a 
comprehensive account of bootstrap iteration and calibration, see Hall (1992). 

For a finite dimensional parameter, another way of making the statistic more pivotal 
is to do studentization using a consistent estimate of asymptotic variance of the original 
statistic. For dependent data, this typically involves the estimation of long run variance 
using the lag window type estimate. Although theoretically possible, consistent estimation 
can be difficult to carry out in practice for some statistics. For example, ii k = p = 1, 
6 = median (F) and 6'„ = median (Xi, ■ ■ ■ , X„), then 

oo 

E(p) = {^9\e)}~' Yl - 21(^0 <o),i- 21(X, < e)} 

k=—oo 

with g{-) being the density function of Xi. Consistent estimation of S(P) involves kernel 
density estimation for g{6) and long run variance estimation for the transformed series 
1 — 21{Xt < 6), both of which involve the choice of a bandwidth parameter. By contrast, 
subsampling and the moving block bootstrap can be used to provide consistent variance 
estimate, which lead to a studentized statistic, or a p-value, which is more pivotal than the 
original unstudentized statistic. Both methods are relatively easier to implement, although 
they also require the user to choose the subsampling window width or block size. The 
self-normalized approach of Shao (2010a), which uses recursive subsample estimates in its 
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studentization, would be another good candidate when a direct consistent long run variance 
estimation is difficult, although there is an efficiency loss under certain loss functions. 

4 Infinite dimensional parameter 

In previous sections, our discussion focuses on the inference of a finite dimensional pa- 
rameter, for which a i/n-consistent estimator exists and the asymptotic normality holds. 
In general, the use of subsampling and block bootstrap methods are not limited to the 
inference for finite dimensional parameters. In the time series setting, they have been used 
to provide an approximation of the nonpivotal limiting distribution when the parameter 
of interest is of infinite dimension, such as marginal distribution function and spectral dis- 
tribution function of a stationary time series. In what follows, we use ||F — G||oo to denote 
suPis-D l-^(^) ~ where D = [—00, 00] in Section Wl] and D = [0, vr] in Section 

4.1 Marginal distribution function 

Consider a stationary sequence {Xk,k G Z} and let m{s) = P{Xo < s) be its marginal 
distribution. Given the observations {Xt}^^i, the empirical process is defined as m„(s) = 
Sfc=i ^ More generally, we define the standardized recursive process 

[nt\ 

Kr,{s, [nt\) = n-^l'' ^{l(Xfc < s) - m(s)}, t e [0, 1]. 

k=l 

Under certain regularity conditions [see Berkes et al. (2009)], we have that 

K^{s,[nt\)^K{s,t). (4) 

Here K{s, t), (s, t) G [—00, 00] x [0, 1] is a two-parameter mean zero Gaussian process with 

cov{K{s, t), K{s', t')} = (t A t')r(s, 

where r(s,s') = YlT=-oo'^'^^{^i-^o — — ^')}- To construct a confidence band for 

m(-), we note that by the continuous mapping theorem, (jlj) implies that y/n\\mn—m\\^ -^^ 
supggjg \ K{s, 1)|. Since K{s, 1) is a Gaussian process with mean zero and unknown covari- 
ance cov{K{s,l), K{s',l)} = r{s,s'), direct inference of m(-) is difficult. To circumvent 
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the difficulty, both the moving block bootstrap and subsampling have been proposed to 
approximate the limiting distribution sup^gjg 1^(5, 1)| consistently; see Biihlmann (1994), 
Naik-Nimbalkar and Rajarshi (1994), and Politis et al. (1999b). Below we shall focus 
our discussion on the subsampling method, and a similar argument applies to the mov- 
ing block bootstrap approach in view of the argument in Section 12.21 Let gn(t,s) = 
l^^'^{mt^t+i~iis) — ''^n(s)}, t = l,---,N = n — l + lhe the subsampling counterpart of 
n^/^{m„(s) — m(s)}, where mt^t+i-i{s) = Xlli't"^ l(^fe ^ s) . Assuming l/n+l/l = o(l) 
and other regularity conditions, Politis et al. (1999b) showed that the subsampling ap- 
proximation based on {gn{t, s)}^i is consistent in certain function space. This implies that 
the sampling distribution of -\/ri||m„ — m||oo (or the distribution of sup^gj^ \K{s, 1)|) can 
be consistently approximated by the empirical distribution of {\/l\\mt^t+i-i — ""^nllooltli- 
The above result is obtained under the small-6 asymptotics. To introduce our calibration 
method, we again start with the p-value and study its limiting null distribution under the 
fixed-6 asymptotics. For notational simplicity, we do not distinguish the true marginal dis- 
tribution function m(x) and the hypothesized function mo(x), because they are identical 
under the null hypothesis. 
Define the p-value 

N 

pval^i = N~'^ ^ 1 {l^^^\\mjj+i_i - m„||oo > - m||oo} • (5) 

Let b = l/n. Under the fixed-fe asymptotics, the limiting null distribution of the p-value is 
the distribution of J{b), where 

J(b) := {l-by^ [ 1 \sup\K{s,r + b)~K{s,r)-bK{s,l)\/Vb>sup\K{s,l)\\dr. 

Jo I seR s6R J 

Note that the distribution of J{b) is not pivotal for a given b, because it depends upon the 
Gaussian process K{s,t), whose covariance structure is tied to the unknown dependence 
structure of Xf. So subsampling at the ffist stage is insufficient under the fixed-6 asymptotic 
framework. It is worth noting that in the iid setting, the quantity ^/n\\mn — m\\oo is pivotal 
provided that m is continuous, so the inferential difficulty is mainly caused by the presence 
of unknown weak dependence. 

To make the inference feasible, we propose to approximate the sampling distribution 
of the p-value or its limiting null distribution by subsampling; see Section 13.11 Let n' be 
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the subsampling window size at the second stage, /' = \n'b'\ and N' = n' — I' + 1. For each 
subsample {Xt, ■ ■ ■ ,Xt+n'~i}, the subsamphng counterpart of pval^i is defined as 



t+N'-l 

hn',t = {N')~^ ^ 1 jV/'llmjj+i/.i - mt,t+n'-l\\oo > Vn/Wmt^t+n'-l - "^n||oo| 

j=t 

for t = l,---,n — n'+l. Then we can approximate the samphng distribution of pval^^ or 
its hmit null distribution J{b) by the empirical distribution associated with {/?-«',*}"=" 
denoted as Jn,n'{x) = {n — n' + ^)~^ ^t=i ^i^n' ,t < x). For a given a G (0,1), the 
100(1 — a)% traditional subsampling-based confidence band for m(-) is 

{m : m is a distribution function and pval^i in (|5]) > a}, 

and the calibrated confidence band is 

{m : m is a distribution function and pval^^i in ([5]) > Cny^i{a)}, (6) 

where Cn,n', /(I— a) = inf{x : Jn,n'{x) > 1—a}. The following theorem states the consistency 
of subsampling at the second stage, which implies that the coverage for the calibrated 
confidence band is asymptotically correct. Let 



VJr, e) := P 



snp\K{s,r + b) - K{s,r) -bK{s,l)\/Vb-snp\K{s,l] 



Theorem 3. Assume that 1/n' + n'/n = o(l), and b G (0, 1] is fixed, (a) The limiting 
null distribution of the p-value in ^ is the distribution of J{b) provided that Vf,(r, 0) = 
for every r G [0, 1 — 6]. (b) Suppose that the process Xt is a-mixing, J{b) is a continuous 
random variable and Vb{r., e) = for every r G [0, 1 — 6] and e > 0. Then we have 

sup \Jn,n'{x) - P{J{b) < X)\ = Op(l). 

Consequently, the asymptotic coverage probability of confidence band in ^ is (1 — a). 

The conditions on J{b) and Vb{r, e) are technical ones that are not easy to verify. The 
verification seems related to the regularity of the distribution of the maximum of Gaussian 
processes; see Diebolt and Posse (1996), Azai's and Wschebor (2001) and references therein. 
We conjecture that they hold for a large class of Gaussian processes. Note that our 
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calibration is based on the subsampling based approximation to sampling distribution of 
the p- value, which is obtained by doing the subsampling in the first stage. As the p- value is 
a prepivoted statistic, we are effectively combining the prepivoting idea with subsampling 
in the infinite dimensional parameter case, for which the usual studentizing technique in the 
finite dimensional parameter case does not seem to apply. The idea of prepivoting (using 
the p-value) in the infinite dimensional parameter case seems new and quite general. We 
can also use the moving block bootstrap in the first stage to obtain a p-value or in the second 
stage to approximate the sampling distribution of the p-value. But the implementation 
of the moving block bootstrap in this setting seems very computationally demanding, 
especially when the block size is chosen through some data driven algorithms. For this 
reason, we shall focus on the subsampling method in simulation studies for the infinite 
dimensional case. 



4.2 Spectral distribution function 

Another infinite dimensional parameter of interest in time series analysis is the spectral 
distribution function F{X) = f{w)dw, X G [0,7r], where /(■) is the spectral density 
function of {Xt}. Let Iniw) = (27™)"-*^ — X„,)e**"'| be the periodogram. A 

commonly used estimator for F{X) is Fn{X) = In{w)dw or its discretized version Fn{X) = 
(27r)/'n, ^Q^27rs/n<A -^"(^^'^Z'^)- been shown that the two versions are asymptotically 

equivalent [Dahlhaus (1985a)] and we shall use the discrete version for the computational 
convenience. Under certain regularity conditions, we have that y/n{Fn{X) — F {X)} =^ G{X), 
where G{X) is a mean zero Gaussian process with covariance 

/•AAA' p\ pX' 

C(A, A') = cov{G(A), G{X')} = 2n f{w)dw + 2tt / U{wi, -Wi, -W2)dwidw2. 

Jo Jo Jo 

Here /4 (■,■,■) is the fourth order cumulant spectrum. For various sets of conditions for this 

weak convergence to hold, see Brillinger (1975), Dahlhaus (1985b) and Anderson (1993). 

Applying the continuous mapping theorem, we get 

V^\\Fn-F\\^^D sup |G'(A)|. (7) 

AG[0,7r] 

Since the covariance of G'(A) depends on unknown second order and fourth order spectrum, 
the distribution of sup;^^^ ,^] |G'('^)| is unknown and is usually difficult to estimate directly. 
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which renders the confidence band construction for F a hard task. To alleviate the prob- 
lem, Politis et al. (1999b) proposed to apply the subsampling method to approximate the 
limiting distribution in ([7]) and they proved the consistency. See Politis et al. (1993) for 
some related numerical work. Often in practice, the main interest is on the pattern of de- 
pendence described in terms of autocorrelations, then the normalized spectral distribution 
function F{X) = F{X)/F{'k), A G [0, vr], which does not depend on the marginal variance of 
Xt, is of more practical relevance. Politis et al. (1999b) mentioned that the subsampling 
method is still consistent in the approximation of the sampling distribution or the limiting 
distribution of ^/n\\Fn — -F||oo, where -F„(A) = F„(A)/F,j(7r). 

To introduce our calibration method, we need to define the estimate of F{X) based on 
the subsample {Xt, ■ ■ ■ ,Xt') for 1 < t < t' < n. In particular, we define the periodogram 
on the basis of the subsample {Xt, ■ ■ ■ ,Xt'} as It,t'{'w) = {27r(t' — t + l)}^"*^! ^]=t{^j ~ 
Xt,t')exp{ijw)\^ where Xt,t' = (t'-t+l)-i ^5'=* ^M'(A) = hAw)dw, and Ft, t'W = 
Ft,t'{^) / Ft^t'iT^)- The subsampling method approximates the sampling distribution of 
^/n'^Fn — -F||oo by the empirical distribution generated from y/l^Ft^t+i-i — -^l,?^||oo5 t = 
1, • • • , and the corresponding p- value is 

N 

pval% = iV-i ^ 1 - > M\Fn - F\\oo] • (8) 

t=i 

n 

Under the small-b asymptotics, the limiting null distribution of pval^^ is U{0,1), but 
under the fixed-6 asymptotics, the limiting null distribution is expected to depend on b 
and the intricate second and fourth order dependence structure of Xt. The derivation of 
the limiting distribution of the p-value relies on the functional central limit theorem for 
-y/ri{Fi Lnrj (A) — F(A)}, (r. A) G [0,1] x [0,7r], which seems unavailable in the literature. 
In view of Theorem 1 in Shao (2009), Theorem 2 in Shao (2010a), and Theorem 3.3 in 
Dahlhaus (1985b), we conjecture that 

v/^{Fi,Lnrj(A) -F(A)} H{r,X), (9) 

where H{r,X) is a mean zero Gaussian process with covariance coy {H {r, X), H{r' , X')} = 
{r Ar')C{X,X'). Let H{r,X) = {H{r,X)F{TT) - F{X)H{r,7r)}/F^{7r). Then Q implies 
that \^{Fi,^nr]{^) — F{X)} =^ H{r,X) by the continuous mapping theorem and that the 
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limiting null distribution of the p-value is the distribution of 

(1-6)"^ / l( sup \H{r + b,\)-H{r,\)-bH{l,X)\/Vb> sup \H{l,\)\]dr, 

Jo \A6[0,7r] Ae[0,7r] J 

which is not pivotal. Following the calibration idea described in Section 14.11 we apply 
the subsampling method to approximate the sampling distribution of the p-value. For a 
given subsampling block size n' at the second stage, let /' = max( [n'6] , 2) since a minimum 
sample size of 2 is needed to estimate the spectral distribution function. Let A^' = n' — I' + 1 
and 



t+N'-l 

K',t = [NT' Yl 1 {"^Whj+l'-l - ^M+n'-llloo > V^\\Ft,t+n'^l - ^rJloo} 
j=t 

for t = 1, ■ ■ ■ , n — n' + 1. The traditional subsampling-based 100(1 — «)% confidence band 
for F(-) is 

{F : F is a normalized spectral distribution function and pval^i in ([H]) > «}• 

In contrast, the calibrated confidence band is 

{F : F is a normalized spectral distribution function and pval^i in ([8]) > Cn,n' ,i{oi)} (10) 

where Cn,n',i{^ — a) = inf{x : {n — n' + 1)^^ Yl^=i Mhn',t < x) > 1 — a}. If ([9]) is true, 
then the confidence band in (fTOj) is expected to have 100(1 — a)% coverage asymptotically 
under appropriate mixing and moment conditions and the assumptions that 6 G (0, 1] is 
held fixed and 1/n' + n' /n — as n — )■ oo. 

5 Simulation results 

In this section, we conduct simulation studies to evaluate the accuracy of the asymptotic 
approximations provided by both small-6 and fixed-6 approaches to the finite sample dis- 
tribution. Specifically, we examine the empirical coverage probabilities and the volumes of 
confidence sets to see if the fixed-6 approach corresponds to smaller coverage errors. 
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5.1 Finite sample performance of confidence intervals 

In this subsection, we consider a univariate stationary time series model with various types 
of dependence structure. To be specific, we let 

Xt = fi + Uu Ut = put-i + et + 6et-i, et ~ iid iV(0, 1). 

We consider (i) AR(l)-iV(0, 1) error: (p, 6) = (0, 0), (0.5, 0) and (0.8, 0); (ii) MA(1)-Ar(0, 1) 
error: (p, 6) = (0, -0.5); and their corresponding AR(1)-EXP(1) and MA(1)-EXP(1) mod- 
els, where et ~ iid EXP(l) — 1 has mean zero, unit variance but with an asymmetric distri- 
bution. Following the suggestion of a referee, we also include two nonlinear time series mod- 
els: Nonlinear 1, Xt = 0.6 sin{Xt-i)+et, where et ~ iid N{0, 1). This model was used in the 
simulation work of Paparoditis and Politis (2001) and Shao (2010c); Nonlinear 2 (threshold 
autoregressive model of order 1), Xt = 0.3Xt„il(Xt_i > 0) + 0.8Xj_il(Xj_i < 0) + e^, 
where et ~ iid N{0, 1). Sample size n = 100 and the number of bootstrap replications is 
5000. The bandwidth parameter / varies from 3 to 16, i.e. b = 0.03,0.04,- ■■ ,0.16. We 
examine the empirical coverages and average widths of symmetric confidence intervals for 
p = E(Xi) and the 25% trimmed mean based on 10000 replications. Nominal coverage is 
set to be 95%. 

For the models with normally distributed errors, the results for the mean case are 
depicted in Figure [H in which the left panel shows the empirical coverages and the right 
panel shows the corresponding ratios of average interval widths (fixed-6 over small-6). 
The symbols "SS" and "BB" stand for subsampling and the moving block bootstrap, 
respectively. For both subsampling and the moving block bootstrap, the undercoverage 
occurs and it gets more severe as the dependence strengthens. The empirical coverages for 
the fixed-6 approach are closer to the nominal level than those for the small-6 approach, 
with the difference between two empirical coverages increasing as b gets large. On the 
other hand, the fixed-6 based interval is slightly wider than its small-6 counterpart, with 
the ratio of widths increasing with respect to b in general. These findings are consistent 
with the intuition that the larger b is, the more accurate the fixed-6 based approximation 
provides relative to its small-6 counterpart. The intervals constructed based on the moving 
block bootstrap have noticeably better coverage than the ones based on subsampling, 
especially for large b. For the MA(1) model with 6 = —0.5, there is an overcoverage for 
the fixed-6 based interval, which is usually slightly more conservative than the small-6 
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counterpart. The overcoverage in the case of negatively correlated time series corresponds 
to the underrejection for Kiefer and Vogelsang's (2005) studentized statistic when using 
normal approximation (i.e. small-6 approach) and b is small (see Figure 1 therein), so our 
results are in a sense consistent with those in Kiefer and Vogelsang (2005). Practically 
speaking, the overcoverage is less harmful to the practitioner than the under cover age, so 
are less concerned in practice. 

The results for the models with exponentially distributed errors as presented in Figure [2] 
are very similar to the ones for normally distributed errors, suggesting that the asymmetric 
shape of exponentially distributed errors has little impact on the finite sample performance. 
Figures [3] and m present the results for the trimmed mean case, which are fairly similar to 
the results in the mean case. Additionally, the results for the nonlinear models in Figure [5] 
resemble those for AR(1)-N(0,1) models with p = 0.5 in both the mean and the trimmed 
mean case, indicating that nonlinearity does not affect our results much. 

Due to the duality of confidence interval construction and hypothesis testing, we would 
expect that the fixed-b approach leads to better size (i.e. size closer to the nominal one) 
in all the models except MA(1) with 6 = —0.5, at the sacrifice of (raw) power. The power 
loss is expected to be moderate because the ratio of fixed-6 based interval width over the 
small-6 based interval width is quite close to 1. Overall, the simulation results demonstrate 
that the fixed-6 approach delivers more accurate inference for both subsampling and the 
moving block bootstrap in most situations owing to its more accurate approximation to the 
finite sample distribution. Of course, we only show the improved accuracy of the fixed-fe 
approximation for a specific a = 0.05, which is also what Kiefer and Vogelsang did. We 
also tried a = 10% and qualitatively similar results are obtained. It would be interesting 
to provide some theoretical justifications on the order of the error rejection probability. 

SUB 

For the subsampling method, this boils down to the order of sup^^jg i] \P{pval^ i < a) — 
P{G{l/n) < a)\ under the fixed-6 framework. Note that under the small-6 framework, the 

SUB 

error is sup^gjQ ^ \P{pval^i < a)—a\, which is expected to be larger. A formal theoretical 
proof seems quite challenging and is left for future research. 
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5.2 Finite sample performance of confidence regions and confi- 
dence bands 

In this subsection, we examine the coverage probabihties of confidence regions for the 
vector parameter of mean and median, and confidence bands for the marginal distribution 
function m(-) and the normahzed spectral distribution function F{-). Let {Xt}^^^ be 
generated from the AR(1) model: Xf = pXf-i + e^, where p = —0.6,0,0.5,0.8, ej ~ 
iid A^(0, 1) or EXP(l) — 1. Sample size n = 200 and number of replications is 1000. 
We use the Euclidean norm in the confidence region construction. For both confidence 
regions and confidence bands, we compared the following three schemes: (1) traditional 
subsampling-based confidence region (band); (2) calibrated subsampling-based confidence 
region (band) with a fixed n', where n' = 15 for confidence region construction and n' = 
30 for confidence band construction; (3) calibrated subsampling-based confidence region 
(band) with n' chosen in a data driven fashion. Here we employ a variant of a block size 
selection procedure proposed in Bickel and Sakov (2008) for the m out of n bootstrap (also 
see Gotze and Rackauskas (2001)), which is closely related to the subsampling method. 
The use of Bickel and Sakov's automatic bandwidth selection in the subsampling context 
has been explored in Jach et al. (2011) recently. The procedure consists of the following 
steps (in the confidence band case): 

Step 1 For a predetermined interval [Ki,K2] and g G (0, 1), we consider a sequence of n/s 
of the form n, = [g^-'K2\ , for j = 1, 2, ■ ■ ■ , [\og{K2/K,)/{- \ogig)}\ . 

Step 2 For each rij, find Jn,nj, where Jn,nj is the subsampling-based distribution estimator 
for the sampling distribution of the p-value. 

Step 3 Set jo = argmin^-^^ ... Liog(i^2/i^i)/{-iog(3)}j ^^Pxm\Jn,n,{x) - Jn,n,+i{x)\. Then the 
optimal block size is g^°K2- If the difference is minimized for a few values of j, then 
pick the largest among them. 

In our simulation experiment, we set [Ki, K2, g) = (5,40,0.75) for confidence region 
construction and {Ki, K2, g) = (10, 60, 0.75) for confidence band construction, which corre- 
sponds to a sequence of block lengths as (40, 30, 22, 16, 12, 9, 7, 5) and (60, 45, 33, 25, 18, 14, 10), 
respectively. 
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Figures M and [7] depict the empirical coverages and the ratios of the radii of the confi- 
dence regions over that dehvered by the uncahbrated traditional subsampling-based region 
for the vector parameter and for the models with normally distributed errors and exponen- 
tially distributed errors, respectively. The symbols "Traditional", "Calibrated (fixed)" and 
"Calibrated (data-driven)" correspond to the schemes (l)-(3) described above. As the find- 
ings for the normally distributed case and the exponentially distributed case are very close, 
we shall only describe the results for the normally distributed case. When p = 0, 0.5, 0.8, 
there is an undercoverage associated with the traditional subsampling-based approach and 
the coverage errors increase with respect to the magnitude of dependence. The improve- 
ment in coverage offered by the calibration is apparent in these cases and it holds uniformly 
over the range of bs under examination. On the other hand, the corresponding radius of the 
calibrated region is slightly larger than that of the uncahbrated counterpart. In the case 
p = —0.6, the calibrated region performs worse compared to the traditional counterpart 
when b is small, but still offer some improvement when b is large. It is not fully clear why 
this phenomenon occurs. Nevertheless, it suggests that caution has to be exercised in the 
use of fixed-6 based calibration when the autocorrelations of the series have alternating 
signs. 

Figures |8H9] have the same format as Figure |6] and their right panels show the ratios 
of the mean band widths over that delivered by the uncahbrated traditional subsampling- 
based band. For the marginal distribution function, there is an apparent undercoverage for 
the traditional subsampling-based confidence band in all cases with coverage errors increas- 
ing with respect to the magnitude of dependence (compare the plots for p = 0,0.5,0.8), 
especially at small bs. When p = 0, 0.5, 0.8 and for almost all b = 0.01, ■ ■ ■ , 0.2, the cov- 
erages delivered by the calibrated bands based on fixed or data driven subsampling width 
are closer to the nominal level than the traditional counterpart. When p = —0.6, the 
calibrated bands based on the fixed or data-dependent bandwidths improve the coverage 
when b > 0.04, but fails to do so when b = 0.01,0.02,0.03, suggesting that potential im- 
provements can be made about the selection of n'. In all cases, the calibrated bands are 
slightly wider than the uncahbrated counterpart, but the ratios are quite close to 1. The 
"better coverage but wider band" phenomenon is in accordance with the "better coverage 
but wider interval" finding in the scalar parameter case. The two calibrated bands perform 
similarly in most situations, and their performance is strikingly close when p = 0.8. As 
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seen from Figure O which plots the empirical coverages and ratios of mean band widths 
with respect to 6 = 0.04, ■ ■ ■ , 0.3 for the normalized spectral distribution, the improvement 
of the calibration in terms of coverage error is quite substantial when p = —0.6, 0.5, 0.8. 
In the case p = 0, the calibrated bands are conservative when b is relatively small, but 
again provides some improvement when b is close to 0.3. Overall the results for the nor- 
malized spectral distribution function are qualitatively similar to those for the marginal 
distribution function. Based on the simulation results for confidence intervals reported in 
Section 15.11 and for confidence regions and bands reported in this subsection, it appears 
that the calibration works very effectively when the series is positively dependent. 

6 Conclusion 

Subsampling and block-based bootstrap methods have been shown to be widely applicable 
to many inference problems in time series analysis. The fixed-6 asymptotics developed 
here explicitly captures the choice of bandwidth parameter in subsampling and the mov- 
ing block bootstrap, and the resulting first order approximation is expected to be more 
accurate than that provided by the small-6 asymptotics. As demonstrated in Section |5l 
the fixed-6 based calibrated confidence intervals (regions, bands) provide an unambiguous 
improvement over the uncalibrated counterparts in terms of coverage errors in most cases 
considered. Our calibration method is developed by estimating the sampling distribution 
of the p-value, which relates to the prepivoting method by Beran (1987, 1988) and the 
confidence coefficient calibration method by Loh (1987). However, our proposal differs 
from theirs in two important respects: (i) the limiting null distribution of the p-value is 
not (necessarily) f/(0, 1), which is the case for Beran (1987, 1988). In our setting, a piv- 
otal limiting distribution exists in the scalar parameter case, but not in the case of vector 
parameter and infinite dimensional parameter, for which the subsampling method is used 
to provide a good approximation; (ii) Their discussions are limited to the iid setting and 
inference for finite dimensional parameters. In contrast, our treatment goes substantially 
beyond their developments by allowing for time series data and the inference of infinite 
dimensional parameters. Coupled with the recently developed fixed-6 approach [Kiefer and 
Vogelsang (2005)] in econometrics literature, we provide a general recipe for the calibration 
of the traditional resampling-based inference procedures when smoothing parameters, such 
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as window width in subsampling and block size in the moving block bootstrap are used to 
accommodate the dependence. 

To conclude the paper, we provide a discussion of open problems and possible exten- 
sions. (1) Our method can be used as a calibration tool for a properly chosen smoothing 
parameter and it is practically important to choose the smoothing parameter in a sensible 
way. The choice of subsampling width and block size for the block-based bootstrap has 
been discussed in Chapter 9 of Politis et al. (1999a) and Chapter 7 of Lahiri (2003). It 
seems natural to ask if it is meaningful to consider the optimal smoothing parameter se- 
lection from a fixed-6 based viewpoint, as opposed to the small-6 based approach [see e.g. 
Biihlmann and Kiinsch (1999) and Politis and White (2004)]. A high order expansion of 
the sampling distribution of the p-value under the null and alternative seems needed to 
tackle this issue. (2) The development in this article is confined to time series, although 
subsampling and block based bootstrap methods have been extended to spatial settings 
[see Chapter 5 of Politis et al. (1999a) and Chapter 12 of Lahiri (2003) and references 
therein]. An extension of the fixed-6 based calibration idea to spatial settings is expected 
to be possible but seems nontrivial for irregularly spaced spatial data. (3) In addition, 
we impose the weak dependence throughout so the asymptotic normality or functional 
central limit theorem with ^Jn convergence rate hold. When the time series is long-range 
dependent, the subsampling method has been proved to be consistent in some situations 
[see Hall et al. (1998), Nordman and Lahiri (2005)]. It would be interesting to extend 
the fixed-6 approach to calibrate the subsampling based inference in these settings. (4) 
A close relative of the block-based bootstraps is the so-called sieve bootstrap [Biihlmann 
(1997)], which also involves a bandwidth parameter (i.e., the order of the approximating 
autoregressive model). It is natural to ask whether it is possible to extend the fixed-& 
approach to calibrate the sieve bootstrap based confidence sets. We leave these possible 
extensions for future work. 



7 Appendix 

Proof of Theoremdl For the convenience of notation, let = IF{Xh] F) and A = Z1(P)^/^. 
Further let T„,, = 1(|| v^(^„ - ^o)|| < ||v^(^,j+/-i - ^n)||) and f^j = l[\\n~'/^ Yjll < 
\\l-'^nEi=-'Y, - {IMEU^M]. Thenp^C = iV"! E.li Tn,,- Let D.(e) = 
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{||i/ni?i,„|| < e,supj^^... ||A//i?jj+i_i|| < e} for any e > 0. Then P{D„(e)} 1 
n — )■ oo. On Dn{€), we have that 



as 



17^ • — T -I < 1 



n 



ft=j j=i 



< 2e 



So the expression ^ Xl^i l^n.i ~" bounded by 



TV 



-1/2 



j+l-l n 



< 2e 



which, by the continuous mapping theorem, converges in distribution to I{b,e), where 



me) ■.= {l-b)-' 



1-6 



\AWJ1] 



A{Wk{b + t)- Wk{t) - bWk{l)}/Vb 



< 2e 



dt. 



It is not hard to see that for each t G [0, 1 — 6], the integrand in I{b, e) J, almost surely as 
e J, 0, which implies that lime^o I{b, e) = almost surely by the Lebesgue dominated con- 



vergence theorem. Since Xl^Li^nj G{b] k) by the continuous mapping theorem, 
the conclusion follows by letting e J, and n — > oo. 

We provide a justification for the use of the continuous mapping theorem above. For 
any x G -D'^[0, 1], define the functional 



and 



A(x) = (1-6)^1 



Ux) = {l-b)-^ 



\x{l) 



{x{b + t) - x{t) - bx{l)}/^/b 



1-6 



< 2e 



dt. 



dt. 



|a;(l)|| < {x{b + t)-x{t)-bx{l)}/Vb 

To use the continuous mapping theorem, we need to show that both /i and /2 are 
^W^fc(') "Continuous almost surely. We shall focus on fi and the same argument applies 
to /2. Define Df^ = {x : fi is not continuous at x}. Then 

Df^ C % = [x : \{t G [0, 1 - 6] : ||x(l)|| - {x{b + t)- x{t) - bx{l)}/Vb = ±2e} > 0}, 

where A stands for Lebesgue measure. It is enough to show P{AWk{-) G -D/J = 0. To this 
end, we note that 

E 



1(I|AW^.(1)||- 

"1-6 







{AWk{b + t)- AWk{t) - bAWk{l)}/Vb = ±2e)dt 

{AWkib + t)- AWkit) - bAWk{l)}/Vb = ±2e)dt = 
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where we have used the fact that for each t E [0, 1 — 6], 



PiWAWJl) 



{AWk{b + t) - AWkit) - bAWk{l)}/Vb = ±2e) = 



The fact flTTl) can be easily shown by noticing that the joint distribution of {AWk{l), {AWk{b+ 
t) — AWk{t) — bAWk{l)}/Vb) is multivariate normal with a positive definite covariance 
matrix. So P{AWk{-) G -D/J = holds and the use of the continuous mapping theorem is 
justified. The proof is thus complete. <) 
Proof of Theorem O The proof is similar to that of Theorem [HI so we omit the details. ^ 
Proof of Theorem [3l (a) The proof follows from the use of the continuous mapping theorem. 
Here the mapping / : oo, oo] x [0, 1]) — )■ M is defined as 

f{x) = {l — b)^^ / 1 < sup \x{s,r + b) — x{s,r) — bx{s, 1)1/ Vb > sup \x{s,l)\? dr. 

Jo [_ seR sgm J 

Following the argument in the proof of Theorem [H we can show that if Vb{r, 0) = for 
every r G [0, 1 — 6], then the mapping / is /'^-continuous, i.e., the probability that the 
Gaussian process K{-, ■) falls into the discontinuity set of / is zero. This completes the 
proof. 

(b) In view of the continuity assumption of J{b) and the monotonicity of Jn,n'{x), it 
suffices to show Jn,n'{x) = P{J{b) < x) + Op(l) for each x G M. Let 

t+N'-l 

for t = 1, ■ ■ ■ , n — n' + 1 and Jn,n'{x) = {n — n' + Ylt=i l(^n',t < x). Note that 



^n'\\mt^t+n'-i - m\\oo - vra'||m.„ - m||oo < V n' \\mt^t+n' -i - rrir, 
< Vn'\\mt,t+n'~i - m\\oo + Vn/\\mn - m||oo. 
For any e > 0, let En{e-) = {^Al'||m„ — m||oo < e} and 



P 



sup\K{s,r + b) - K{s,r) -bK{s,l)\/Vb-sup\K{s,l] 



self 



< e 



Then P{En{e)} — 1 as n — !■ oo. On En^^), we have that for each t = 1, ■ ■ ■ , n — n' + 1, 

\hn',t - hn',t\ < Wn{t; e), where 

t+N'-l 



Wn{t;e):={N')-' ^ 1 { | v^||m,-,-+^,_i - mt,j+. 



'-illoo - Vn'\\mt^t+n'~i - m\ 



< € 
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By stationarity, we have that 

N' 



E|/in',f - /in',t|l{-E'n(e)} < {N') ^ ^ P | v^|| j+j/.i - mi,„/ 1| oo " Vr7|| - m|| oo < e| 

^ L{b,e) := (1-6)-^ / Vhir,e)dr 

Jo 

The above convergence follows from Theorem 3 of Ferguson (1996) and the fact that 
Wn{l]e) -^D J{b,e), where 



J(6,e) := (l-b)-' 



1-6 



sup\K{s,r + b) - K{s,r) -bK{s,l)\/Vb-snp\K{s,l] 



< e> dr 



Again the continuous mapping theorem is invoked to derive the weak convergence of 
Wn{l,€) and following the argument in the proof of Theorem [H its use can be justified 
under the assumption that Vh{r, e) = for each r G [0, 1 — 6] and e > 0. 

Next it is not hard to see that lim^iQ L{b,e) = since Vfe(r, e) | Vb(r, 0) = as e ^ 
for every re [0, 1 - b]. Thus sup^^^ ... E|/i„/^( -K'A < ^K',i - K' MHEnie)} + 

2P{En{^Y) < e for large enough n. Furthermore, 



Jn,n'{.X-^)-{n-n' +1) ^ ^ '^{\hn',t- K',t\> < Jn,n'{.x) 

t=l 

n-n'+l 

< Jn,n' (x + y/e) + (n - n' + 



t=l 

By the Markov inequality, {n — n' + Ylt=i P{\hn',t — ^n',t| > V^} < V^- Using the 
same argument in the proof of Theorem 3.2.1. of Politis et al. (1999a), we can show that 
Jn,n'{x) — P{J{b) < x} = Op(l), which follows from the stationarity and strong mixing 
properties of Xt and the boundness of {hn' ,t}t=i ■ The conclusion then follows from an 
elementary argument. 

References 

Anderson, T., (1993) Goodness of fit tests for spectral distributions. Annals of Statistics, 
21, 830-847. 



29 



Azais, J. M. and Wschebor, M. (2001) On the regularity of the distribution of the maximum 
of one-parameter Gaussian processes. Probability Theory and Related Fields, 119, 70- 
98. 

Beran, R. (1987) Previoting to reduce level error of confidence sets. Biometrika, 74, 457- 
468. 

Beran, R. (1988) Prepivoting test statistics: A bootstrap view of asymptotic refinements. 

Journal of the American Statistical Association, 83, 687-697. 
Berg, A., McMurry, T. and Politis, D. N. (2010) Subsampling p-values. Statistics and 

Probability Letters, 1358-1364. 
Berkes, I., Hermann, S. and Schauer, J. (2009) Asymptotic results for the empirical process 

of stationary sequences. Stochastic Processes and their Applications, 119, 1298-1324. 
Bickel, P. and Sakov, A. (2008) On the choice of m in the m out of n bootstrap and 

confidence bounds for extrema. Statistica Sinica, 18, 967-985. 
Billingsley, P. (1968) Convergence of Probability Measures, Wiley. 

Brillinger, D. (1975) Time Series: Data Analysis and Theory, Holt, Rinehart and Winston, 
New York. 

Biihlmann, P. (1994) Blockwise bootstrapped empirical process for stationary sequences. 

Annals of Statistics, 22, 995-1012. 
Biihlmann, P. (1997) Sieve bootstrap for time series. Bernoulli, 3, 123-148. 
Biihlmann, P. and Kiinsch, H. R. (1999). Block length selection in the bootstrap for time 

series. Computational Statistics and Data Analysis, 31, 295-310. 
Dahlhaus, R. (1985a) On the asymptotic distribution of Bartlett's ?7p-statistic. Journal of 

Time Series Analysis, 6(4), 213-227. 
Dahlhaus, R. (1985b) A functional central limit theorem for tapered empirical distribution 

functions. Stochastic Processes and its Applications, 19, 135-149. 
Diebolt, J. and Posse, C. (1996) On the density of the maximum of smooth Gaussian 

processes. Annals of Probability, 24, 1104-1129. 
Ferguson, T. S. (1996) A Course in Large Sample Theory. Chapman&Hall. 
Goncalves, S. and Vogelsang, T. J. (2011) Block bootstrap HAG robust tests: sophistica- 
tion of the naive bootstrap. Econometric Theory, 27, 745-791. 
Gotze, F. and Rackauskas, A. (2001) Adaptive choice of bootstrap sample sizes. In State 

of the Art in Probability and Statistics, IMS Lecture Notes Monogr. Ser., 36 (ed. 



30 



Aad van der Vaart Mathisca de Gunst Chris Klaassen), pp. 286-309. Cambridge 
University Press. 

Hall, P. (1992) The Bootstrap and Edgeworth Expansion, New York: Springer. 

Hall, P., Lahiri, S. N., and Jing, B.-Y. (1998) On the subsampling window method for 

long-range dependent data. Statistica Sinica, 8, 1189-1204. 
Hampel, F., Ronchetti, E., Rousseeuw, P. and Stahel, W. (1986) Robust Statistics: The 

Approach Based on Influence Functions, New York: John Wiley. 
Hashimzade, N. and Vogelsang, T. J. (2008) Fixed-b asymptotic approximation of the 

sampling behavior of nonparametric spectral density estimators. Journal of Time 

Series Analysis, 29, 142-162. 
Jach, A., McElroy, A. and Politis, D. N. (2011) Subsampling inference for the mean of 

heavy-tailed long memory time series, to appear in Journal of Time Series Analysis. 
Jansson, M. (2004) The error rejection probability of simple autocorrelation robust test. 

Econometrica, 72, 937-946. 
Kiefer, N. M., and Vogelsang, T. J. (2005) A new asymptotic theory for heteroskedasticity- 

autocorrelation robust tests. Econometric Theory, 21, 1130-1164. 
Kiefer, N. M., Vogelsang, T. J. and Bunzel, H. (2000) Simple robust testing of regression 

hypotheses. Econometrica, 68, 695-714. 
Kiinsch, H. (1989). The jackknife and the bootstrap for general stationary observations. 

Annals of Statistics 17, 1217-1241. 
Lahiri, S. N. (2001) Effects of block lengths on the validity of block resampling methods. 

Probability Theory and Related Fields, 121, 73-97. 
Lahiri, S. N. (2003) Resampling Methods for Dependent Data, New York: Springer. 
Lee, S. M. S. and Lai, P. Y. (2009) Double block bootstrap confidence intervals for depen- 
dent data. Biometrika, 96(2), 427-443. 
Liu, R. Y. and Singh, K. (1992). Moving blocks jackknife and bootstrap capture weak 

dependence. In Exploring the Limits of Bootstrap, (Ed. R. LePage and L.Billard), 

225-248. John Wiley, New York. 
Loh, W.-Y. (1987) Calibrating confidence coefficients. Journal of the American Statistical 

Association, 82, 155-162. 
Loh, W.-Y. (1991) Bootstrap calibration for confidence interval construction and selection. 

Statistica Sinica, 1, 477-491. 



31 



Naik-Nimbalkar, U. and Rajarshi, M. (1994) Validity of blockwise bootstrap for empirical 
processes with stationary observations. Annals of Statistics, 22, 980-994. 

Nordman, D. and Lahiri, S. N. (2005) Validity of sampling window method for linear 
long-range dependent processes. Econometric Theory, 21, 1087-1111. 

Paparoditis, E. and Politis, D. N. (2001). Tapered block bootstrap. Biometrika 88, 1105- 
1119. 

Paparoditis, E. and Politis, D. N. (2002). The tapered block bootstrap for general statistics 
from stationary sequences. Econometrics Journal 5, 131-148. 

Politis, D. N. (2011) Higher-order accurate, positive semi-definite estimation of large- 
sample covariance and spectral density matrices. Econometric Theory 27, 703-744. 

Politis, D. N. and Romano, J. P. (1992) A circular block-resampling procedure for station- 
ary data. Exploring the Limits of Bootstrap, (Raoul LePage and Lynne Billard, eds.), 
John Wiley, p263-270. 

Politis, D. N. and Romano, J. P. (1994) Large sample confidence regions based on sub- 
samples under minimal assumptions. Annals of Statistics, 22, 2031-2050. 

Politis, D. N., Romano, J. P. and Wolf, M. (1999a), Suhsampling, Springer- Verlag, New 
York. 

Politis, D. N., Romano, J. P. and You, L. (1993) Uniform confidence bands for the spectrum 
based on subsamples, in Computing Science and Statistics, Proceedings of the 25th 
Symposium on the Interface, San Diego, California. (M. Tarter and M. Lock, eds.). 
The Interface Foundation of North America, 346-351. 

Politis, D. N., Romano, J. P. and Wolf, M. (1999b) Weak convergence of dependent empiri- 
cal measures with application to subsampling in function spaces. Journal of Statistical 
Planning and Inference, 79, 179-190. 

Politis, D. N. and White, H. (2004) Automatic block-length selection for the dependent 
bootstrap. Econometric Reviews, 23, 53-70. 

Sayginsoy, O. and Vogelsang, T. J. (2011) Testing for a shift in trend at an unknown 
date: a fixed-b analysis of heteroskedasticity autocorrelation robust OLS based tests. 
Econometric Theory, 27, 992-1025. 

Shao, X. (2009) Confidence intervals for spectral mean and ratio statistics. Biometrika, 
96, 107-117. 

Shao, X. (2010a) A self-normalized approach to confidence interval construction in time se- 



32 



ries. Journal of the Royal Statistical Society, Series B, 72(3), 343-366. Corrigendum: 
2010, 72(5), 695-696. 

Shao, X. (2010b) Extended tapered block bootstrap. Statistica Sinica, 20, 807-821. 

Shao, X. (2010c) The dependent wild bootstrap. Journal of the American Statistical As- 
sociation, 105, 218-235. 

Shao, X. and Politis, D. (2011) Fixed-& subsampling and block bootstrap: improved confi- 
dence sets based on p-value calibration. Technical Report, Department of Statistics, 
University of Illinois at Urbana-Champaign. Available at ArXiv 

Sun, Y., Phillips, P. C. B. and Jin, S. (2008) Optimal bandwidth selection in heteroscedasticity- 
autocorrelation robust testing. Econometrica, 76, 175-194. 



33 



Table 1: Simulated values of Ga{b), Ga{b), Ha{b) and Ha{b) when fitted with a quadratic 
polynomial cv{b) = ao + aib + 02^^, b G (0,0.2]. a = 0.05,0.1. The simulated values are 
based on n = 5000 and 50000 replications. In the moving block bootstrap case, we use 
50000 bootstrap replications. 
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Figure 1: The empirical coverage probabilities (left panel) and the ratios of interval widths 
(calibrated fixed-fe over traditional small-6) (right panel) for the mean and for the models 
with normally distributed errors. Sample size n = 100 and number of replications is 10000. 
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Figure 2: The empirical coverage probabilities (left panel) and the ratios of interval widths 
(calibrated fixed-6 over traditional small-6) (right panel) for the mean and for the models 
with exponentially distributed errors. Sample size n = 100 and number of replications is 
10000. 
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Figure 3: The empirical coverage probabilities (left panel) and the ratios of interval widths 
(calibrated fixed-6 over traditional small-6) (right panel) for the 25% trimmed mean and 
for the models with normally distributed errors. Sample size n = 100 and number of 
replications is 10000. 
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Figure 4: The empirical coverage probabilities (left panel) and the ratios of interval widths 
(calibrated fixed-6 over traditional small-6) (right panel) for the 25% trimmed mean and 
for the models with exponentially distributed errors. Sample size n = 100 and number of 
replications is 10000. 
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Figure 5: The empirical coverage probabilities (left panel) and the ratios of interval widths 
(calibrated fixed-6 over traditional small-6) (right panel) for the mean (top two plots) and 
the trimmed mean (bottom two plots) for the two nonlinear models. Sample size n = 100 
and number of replications is 10000. 
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Figure 6: The empirical coverage probabilities (left panel) and the ratios of radii of con- 
fidence regions (calibrated fixed-6 over traditional small-6) (right panel) for the vector 
parameter and for the models with normally distributed errors. Sample size n = 200 and 
number of replications is 1000. 
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Figure 7: The empirical coverage probabilities (left panel) and the ratios of radii of con- 
fidence regions (calibrated fixed-6 over traditional small-6) (right panel) for the vector 
parameter and for the models with exponentially distributed errors. Sample size n = 200 
and number of replications is 1000. 
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Figure 8: The empirical coverage probabilities (left panel) and the ratios of band widths 
(calibrated fixed-6 over traditional small-fe) (right panel) for the marginal distribution func- 
tion. Sample size n = 200 and number of replications is 1000. 
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Figure 9: The empirical coverage probabilities (left panel) and the ratios of band widths 
(calibrated fixed-6 over traditional small-6) (right panel) for the normalized spectral dis- 
tribution function. Sample size n = 200 and number of replications is 1000. 
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